Construction and validation of artificial intelligence pathomics models for predicting pathological staging in colorectal cancer: Using multimodal data and clinical variables

Abstract Objective This retrospective observational study aims to develop and validate artificial intelligence (AI) pathomics models based on pathological Hematoxylin–Eosin (HE) slides and pathological immunohistochemistry (Ki67) slides for predicting the pathological staging of colorectal cancer. The goal is to enable AI‐assisted accurate pathological staging, supporting healthcare professionals in making efficient and precise staging assessments. Methods This study included a total of 267 colorectal cancer patients (training cohort: n = 213; testing cohort: n = 54). Logistic regression algorithms were used to construct the models. The HE image features were used to build the HE model, the Ki67 image features were used for the Ki67 model, and the combined model included features from both the HE and Ki67 images, as well as tumor markers (CEA, CA724, CA125, and CA242). The predictive results of the HE model, Ki67 model, and tumor markers were visualized through a nomogram. The models were evaluated using ROC curve analysis, and their clinical value was estimated using decision curve analysis (DCA). Results A total of 260 deep learning features were extracted from HE or Ki67 images. The AUC for the HE model and Ki67 model in the training cohort was 0.885 and 0.890, and in the testing cohort, it was 0.703 and 0.767, respectively. The combined model and nomogram in the training cohort had AUC values of 0.907 and 0.926, and in the testing cohort, they had AUC values of 0.814 and 0.817. In clinical DCA, the net benefit of the Ki67 model was superior to the HE model. The combined model and nomogram showed significantly higher net benefits compared to the individual HE model or Ki67 model. Conclusion The combined model and nomogram, which integrate pathomics multi‐modal data and clinical‐pathological variables, demonstrated superior performance in distinguishing between Stage I–II and Stage III colorectal cancer. This provides valuable support for clinical decision‐making and may improve treatment strategies and patient prognosis. Furthermore, the use of immunohistochemistry (Ki67) slides for pathomics modeling outperformed HE slide, offering new insights for future pathomics research.


| INTRODUCTION
Colorectal cancer is one of the common digestive tract tumors, ranking third globally among malignant tumors and second in cancer-related deaths. 1 The American Joint Committee on Cancer (AJCC) TNM system for colorectal cancer staging is the optimal guide for treatment decisions. 2he pathological TNM staging of colorectal cancer is predominantly based on the assessment of tumor infiltration depth, lymph node invasion, and the existence of metastasis to distant sites, encompassing Stage I, Stage II, Stage III, and Stage IV 3 The diagnosis and prognosis of colorectal cancer patients are closely related to precise staging.Staging-related colorectal cancer prognosis studies have shown an inverse correlation between stage and prognosis, meaning that Stage I-II has a better prognosis than Stage III-IV.2,[4][5][6] For patients with Stage I-II colorectal cancer, the most effective treatment is surgery, often without the need for adjuvant or neoadjuvant therapy.
Colonoscopy is among the most prevalent cancer screening methods and proves to be highly effective in reducing the mortality rate of colorectal cancer. 7owever, the frequent utilization of colonoscopy results in the identification of a higher number of colorectal cancer patients.In essence, this means that an increased number of colorectal cancer specimens necessitate a more extensive involvement of pathologists in delivering precise diagnoses and staging evaluations.Nevertheless, pathological specimen diagnosis depends heavily on the rich personal experience and solid theoretical knowledge of pathologists.Variability among individuals can easily lead to differences between observers. 8As a result, the challenges of pathological staging are amplified because many patients are already in the advanced stage when diagnosed, as early-stage cancer often presents no obvious symptoms.
In recent years, the rapid development of artificial intelligence (AI) and machine learning technologies has provided new opportunities to address this problem.AI is a hot research area in the field of pathological diagnosis.][11][12] Hüneburg and other researchers utilized AI for realtime application in Lynch syndrome patients, revealing that AI-assisted colonoscopy optimizes endoscopic surveillance in lynch syndrome patients, notably enhancing the detection of flat adenomas. 13In a large-scale study conducted in asymptomatic populations in China, Xu et al. compared AI-assisted colonoscopy with traditional methods, indicating a substantial improvement in overall adenoma detection rates with AI assistance. 14Similarly, Wallace et al. conducted a multicenter study in Western countries investigating AI's impact on the miss rate of colorectal adenomas, demonstrating a halved miss rate with AI-assisted detection. 15These findings underscore the clear role of AI in screening and detecting colorectal adenomatous polyps, highlighting AI-assisted colonoscopy as a highly promising approach.However, leveraging immune scoring in predicting prognosis in colorectal cancer faces challenges, restricting its application in prognostication.Foersch et al. developed a multistain deep learning model for predicting prognosis and treatment response in rectal cancer, exhibiting robust predictive performance. 16dditionally, Yang et al. attempted to quantify immune scoring using AI, distinguishing between different risk profiles in stage II colorectal cancer patients. 17These studies suggest that AI holds promise in offering valuable insights into the tumor microenvironment of colorectal cancer.Furthermore, in prognostic research related to colorectal cancer, Susič and colleagues employed machine learning algorithms to predict 1-5 year survival rates in colorectal cancer patients, attempting to identify crucial variables influencing patient survival. 18Wang et al. established a nomogram model based on multi-omics features including pathological, radiological, and immunological characteristics for predicting prognosis of colorectal cancer lung metastasis, demonstrating favorable clinical utility. 19By directly predicting diagnosis, treatment effectiveness, and prognosis from pathological slides, healthcare can be more precisely implemented, making it more efficient. 20esearch on AI in colorectal cancer staging has primarily focused on predicting early colorectal cancer invasion depth using colonoscopy images and predicting lymph node treatment strategies and patient prognosis.Furthermore, the use of immunohistochemistry (Ki67) slides for pathomics modeling outperformed HE slide, offering new insights for future pathomics research.2][23] The former is associated with the T stage, and the latter with the N stage.However, few researchers have conducted studies using machine learning to predict colorectal cancer TNM staging based on colonoscopy or pathological tissue images.
Therefore, this study aims to develop and validate AIbased pathomics models using pathological tissue slide images to predict the pathological staging of colorectal cancer, distinguishing between Stages I-II and III.We aim to provide a powerful tool for physicians to more accurately assess the condition of colorectal cancer patients, offering valuable information for individualized treatment and patient management.This research is expected to provide crucial references and guidance for future colorectal cancer treatment and pathology studies.

| Patient population
Our retrospective study was approved by our institutional ethics review board.Inclusion criteria for this study were as follows: (1) Colorectal cancer pathological tissue slides stored in the form of digital pathology slide scans (whole slide images, WSI), including hematoxylin-eosin (HE) stained slides and immunohistochemical (IHC) slides (Ki67 marker); (2) clear pathological staging; (3) no history of preoperative chemoradiation; (4) no metastasis.Exclusion criteria included: (1) Blurriness in some or all regions of the pathological digital slide; (2) absence of cancer tissue in the pathological digital slide.This study ultimately included data from 267 patients who underwent curative surgery for colorectal cancer in our hospital, with a random 80/20 split into training (213 patients) and testing (54 patients) cohorts.

| Image acquisition and annotation
Pathological tissue slide scanning was performed using a slide scanner provided by Shenzhen Shengqiang Technology Co., Ltd.(http:// www.sqray.com/ produ ct/ list), at 20× resolution.The obtained digital pathology images were in SDPC format and were converted to SVS format.Subsequently, the tumor regions in the pathological WSIs were annotated using QuPath software. 24QuPath is an open-source software specialized for digital pathology image analysis (version 0.4.3, https:// qupath.github.io/ ), used to annotate tumor regions in pathological WSIs. 25 These annotated WSIs were then divided into 512 × 512sized patches. 24The same process was applied to both HE and Ki67 slides.

| Extraction and selection of pathological slide features
The completed patches were subjected to transfer learning on a ResNet-18 model, pre-trained on the ImageNet dataset, to create a deep learning model for recognizing tumor and non-tumor areas in patches.Model training utilized stochastic gradient descent as the optimization algorithm to adjust the weights and biases of the deep learning model, further minimizing the cross-entropy loss function.We used the cross-entropy loss function to train the model to better predict sample labels.The training was carried out with a learning rate of 0.01 and implemented with an adaptive moment estimation optimizer for three epochs with a batch size of 128.After training, the penultimate layer of the fine-tuned deep model was utilized for feature extraction.
The extracted pathological deep features (from both HE and Ki67 slides) were subjected to several operations.First, each feature was standardized by z-score normalization (mean of 0 and standard deviation of 1), making the data conform to a standard normal distribution.Then, Spearman's rank correlation coefficient, a statistic measuring the correlation between two variables, was employed to assess the correlations among features.When the Spearman correlation coefficient between two features was greater than 0.9, one of the features was retained.Finally, feature dimension reduction was performed using L1-regularized least absolute shrinkage and selection operator (LASSO) regression, which selected the most relevant features and generated a sparse model, meaning that only a few features significantly contributed to the prediction outcome, enhancing the model's interpretability and generalization.The selected features were used for constructing the pathological models (HE model or Ki67 model).Furthermore, clinical-pathological variables with univariate regression analysis p-values <0.05 were integrated with deep learning features from HE slides and Ki67 slides.Subsequently, feature selection was applied using the method described above.The selected features were then utilized to construct the combined model (HE_Ki67 model).

| Development and validation of models
In this study, machine learning using LR was employed to construct pathological models (HE model and Ki67 model) and the HE_Ki67 model using the selected fea-

| Statistical analysis
Clinical baseline features were subjected to t-tests, chisquare tests, or Fisher's exact tests using SPSS software (version 25.0, IBM).T-tests were used for continuous variables with homogeneity of variances, presented as x ± s. Chi-square tests or Fisher's exact tests were used for categorical variables, presented as ratios.A two-tailed p-value <0.05 indicated statistical significance.Python software (version 3.7.17;http:// www.python.org) was

| Establishment of deep learning models for identifying tumor regions and extraction of features
HE_ResNet-18 and Ki67_ResNet-18 models were created by utilizing the patches from pathological HE slides and Ki67 slides after transfer learning with ResNet-18.The loss values of the deep learning HE_ ResNet-18 model and Ki67_ResNet-18 model during training patches with iteration steps can be seen in Figure 2.These deep learning models were primarily employed for identifying tumor and non-tumor regions.The performance evaluation of the deep learning models is presented in Table 3.The penultimate layer of HE_ResNet-18 and Ki67_ResNet-18 models was used to extract features from patches, respectively.A total of 260 deep learning features were obtained from pathological HE and Ki67 images, labeled as HE_0 to HE_259 and Ki67-01 to Ki-260.

| Construction and performance of pathomics models and combined model
The extracted feature data was normalized, and features with Spearman's correlation coefficient greater than 0.9 were reduced to one.The λ value corresponding to the minimum mean squared error (MSE) was selected (Figures 3A, 4A, and 5A), and a LASSO regression model was fitted based on the λ value (Figures 3B, 4B, and 5B).Feature dimension reduction was achieved by eliminating features with zero coefficients using LASSO regression.Following feature reduction, 13, 24, and 16 features

| Nomogram construction and models' comparison
In this study, the predictions from the HE model and Ki67 model were used as features for constructing a nomogram, along with clinical variables with a p-value less than 0.05 from univariate regression analysis (Figure 6A).The ROC curve results in the training and testing cohorts are shown in Figure 6B,C.The AUC values in the training cohort were 0.926 (95% CI 0.894-0.958)and 0.817 (95% CI 0.693-0.940) in the testing cohort.Other performance parameters are presented in Table 4. DCA curves for the nomogram and other models are shown in Figure 6D,E

| DISCUSSION
In our study, multiple pathomics models were developed using the LR algorithm based on features extracted from pathological HE slides and Ki67 slides.The HE model was created using features extracted from HE slides, while the Ki67 model was developed using features from Ki67 slides.Furthermore, the combined model (HE_Ki7 model) was constructed based on clinical variables and the two aforementioned feature sets.Finally, the predictive outcomes of the HE model and Ki67 model, along with clinical variables, were incorporated into the construction of a The pathological TNM staging of tumors is crucial for ensuring the appropriate selection of patients for treatment interventions because different stages require different treatment methods. 2 Currently, the pathological TNM staging for colorectal cancer involves pathologists meticulously examining the tissue morphology of tumors and lymph nodes in postoperative curative specimens through a microscope, in combination with judgments based on other relevant clinical examinations.This analytical process consumes a significant amount of time in the work of pathologists.This is due to the need for comprehensive sampling of the tumor area and lymph nodes in curative specimens, which typically requires the preparation of dozens of wax blocks to complete.In other words, pathologists need to review dozens of pathological slides under the microscope to complete the pathological staging of colorectal cancer.Accurate pathological staging is inseparable from the experience and professional knowledge of pathologists, and variations among individuals can easily lead to differences in observations. 8The diagnostic variations in this regard and the relatively time-consuming nature of completing The integration of multimodal feature data from whole-slide images of both HE and Ki67 sections with clinical variables for feature selection, and the evaluation of the combined (HE_Ki67) model's performance constructed with the selected features.Optimal λ values were determined through 10-fold cross-validation and minimizing mean squared error (MSE), as depicted by vertical dashed lines (A).Visualization of least absolute shrinkage and selection operator (LASSO) coefficients for various λ values, with vertical dashed lines indicating the number of features corresponding to the optimal λ value (B).Following the application of LASSO regression for feature selection, only features with non-zero coefficients were retained (C).Presentation of receiver operating characteristic curves to assess the performance of the combined model in both the training and test cohorts (D).
colorectal cancer pathological staging underscore the urgent need for the application of AI in predicting colorectal cancer's pathological staging.This application can enhance diagnostic efficiency, accuracy, and consistency while also reducing healthcare costs for patients.
Research on the pathological staging of colorectal cancer using AI primarily focuses on the prediction of T-stage related to the depth of invasion and N-stage related to lymph node metastasis.Regarding depth of invasion, the use of deep learning on endoscopy images to predict the depth of intestinal wall invasion is a key area of research, particularly for early-stage colorectal cancer (T1 stage).Deep learning models based on endoscopy images for predicting the depth of invasion in gastric cancer have shown better accuracy and specificity in AI predictions compared to real-world endoscopy doctors. 26Furthermore, a deep learning-based model for assessing colorectal cancer invasion, utilizing multimodal data, including endoscopy images, produced results on the validation set that were similar to those of endoscopy doctors, 21 and even outperformed experienced endoscopy doctors. 27This suggests that the prospects for AI in predicting the depth of invasion in colorectal cancer are promising.However, the diagnostic accuracy still presents challenges, 28 and further research data is needed for refinement and support.Currently, the prediction of colorectal cancer's T-stage primarily relies on endoscopy images, and there are no AI models based on pathological tissue images for predicting T-stage.
0][31][32][33] A meta-review of AI models using CT/MRI to predict preoperative lymph node metastasis in colorectal cancer reported an AUC of 0.727. 30tudies on predicting lymph node metastasis in colorectal cancer based on pathological HE-stained whole-slide images have reported validation set AUC values ranging from 0.61 to 0.76. 29,32,33In a few cases, immunostained whole-slide images have been used for predicting lymph node metastasis.One study utilized a random forest algorithm on immunohistochemical cytokeratin-stained whole-slide images to predict lymph node metastasis in early-stage colorectal cancer. 22Another study, which used cytokeratin staining for predicting lymph node metastasis in pT1 stage colorectal cancer, did not show an advantage over HE staining. 34Further research is needed to confirm the value of pathological immunostained whole-slide images in lymph node prediction.
The pathological staging of colorectal cancer involves a comprehensive analysis of tumor infiltration depth, lymph node status, and metastasis.Predicting T-stage or N-stage individually cannot provide a complete reflection of the overall pathological staging.Currently, there is a A significant feature of this study is the integration of pathological data with clinical variables.The combination of deep learning features extracted from HE and Ki67 whole-slide images with clinical variables enhances the accuracy and robustness of the constructed combined model and nomogram.This is likely to provide a more comprehensive perspective on patient conditions.Interestingly, combining features from HE and Ki67 images with tumor markers (CEA, CA724, CA125, and CA242) in the combined model and nomogram results in better predictive performance.Impressive ROC AUC values were achieved in both the training and test datasets (Figure 6B,C), emphasizing the enhancement of predictive accuracy through the application of multimodal data.This finding underscores the importance of integrating different data sources to improve the accuracy of pathological staging, as different data types can capture complementary information.DCA was conducted in this study to assess the clinical utility of the models, reflecting their actual value at different probability thresholds.Importantly, the combined model and nomogram exhibited significantly higher net benefits compared to the HE and Ki67 models (Figure 6D, E).This suggests the potential of these models to assist diagnostic physicians in making more informed staging assessments.
In both univariate and multivariate analyses of this study, serum CA125 and CD242 were identified as independent risk factors.Previous research by scholars has shown an elevation in serum CA125 levels in advanced stages of primary colorectal cancer, 35 and a positive correlation with tumor staging. 36,37Simultaneously, CD242 has been associated with the invasion and staging of colorectal cancer. 38In the study conducted by Björkman et al., CA125 and CD242 emerged as significant prognostic factors for colorectal cancer, with levels increasing alongside higher tumor stages. 39Similar findings were reported by Luo et al., indicating a higher positivity rate for CA125 and CD242 in Stages III-IV compared to Stages I-II in colorectal cancer. 40In other words, there is a higher prevalence of elevated CA125 and CD242 values in Stages III-IV.The serum levels of CA125 and CD242 in this study exhibit a positive correlation with advanced stages of colorectal cancer, consistent with previous research.
Despite the encouraging results, it must be acknowledged that this study has limitations.Its retrospective nature and relatively small sample size may introduce biases and impact generalizability.Prospective studies on larger and more diverse cohorts are needed to further validate these models and their clinical utility.Additionally, this study focused on distinguishing Stage I-II and III colorectal cancer.Expanding the scope of research to include other stages and subtypes may provide a more comprehensive understanding of the potential clinical applications of these models.Finally, it's noteworthy that this study utilized pathologic features extracted by deep learning models.However, deep features inherently possess a "black box" nature, making it challenging to interpret the extracted characteristics.
In conclusion, building AI pathology models using multimodal data and clinical variables to predict the pathological staging of colorectal cancer is a crucial step toward more accurate and personalized healthcare.This study demonstrates the superiority of the combined model and nomogram, potentially providing diagnostic physicians with more information to make wiser staging assessments, thus enhancing patient management and treatment outcomes.Immunohistochemical data, such as Ki67, holds immense potential in the field of pathology and offers new directions for future pathological research and clinical applications.

2. 3 |
The steps and workflow for model construction The model construction process involves the following steps: (1) Collection and preparation of pathological slides and clinical data; (2) tumor annotation of pathological slides and transfer learning with deep learning models; (3) extraction and selection of deep features from pathological slides; (4) division of the dataset into training and testing sets; (5) construction of the pathomics logistic regression (LR) models; (6) validation of the pathomics models.The workflow of the pathomics model in this study is presented in Figure 1.
tures, with colorectal cancer Stage I-II and Stage III as binary outcome variables.The predictive results of the HE model based on HE slides and the Ki67 model based on Ki67 slides were separately used as features, along with clinical-pathological variables with p-values <0.05 from univariate regression analysis, to construct a nomogram.Once models' construction were completed, validation was performed in the testing cohort.Model performance was assessed based on metrics such as the area under the receiver operating characteristic curve (ROC AUC), accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).Subsequently, decision curve analysis (DCA) was conducted to evaluate the clinical utility of the models, reflecting the net benefit at different threshold probabilities in the training and external validation cohorts.

F I G U R E 1
The workflow of pathomics HE model, pathomics Ki67 model, and combined model in this study.

T A B L E 1
Clinical and pathological characteristics in the training and test cohorts.

T A B L E 3
The performance evaluation of the deep learning HE_ResNet-18 model and Ki67_ResNet-18 model.

F I G U R E 3
Feature selection from whole-slide images of pathological Hematoxylin-Eosin (HE) stained sections and the performance of the pathomics HE model constructed with selected features.Optimal λ values are chosen based on 10-fold cross-validation and minimum mean squared error (MSE), represented by vertical dashed lines (A).Display least absolute shrinkage and selection operator (LASSO) coefficients for different λ values, where vertical dashed lines indicate the number of features corresponding to the optimal λ value (B).Following the application of LASSO regression for feature selection, exclusively those features exhibiting non-zero coefficients were retained (C).The receiver operating characteristic curves of the pathomics HE model in both the training and test cohorts were showed (D).

F I G U R E 4
Feature selection from whole-slide images of pathological immunohistochemistry (Ki67) stained sections and the assessment of the pathomics Ki67 model utilizing the chosen features.Optimal λ values were determined through 10-fold cross-validation and minimizing mean squared error (MSE), as depicted by vertical dashed lines (A).Visualization of least absolute shrinkage and selection operator (LASSO) coefficients for various λ values, with vertical dashed lines indicating the number of features corresponding to the optimal λ value (B).Following the application of LASSO regression for feature selection, only features with non-zero coefficients were retained (C).Evaluation of receiver operating characteristic curves for the pathomics Ki67 model constructed in both the training and test cohorts were presented (D).nomogram.The results indicate that the combined model (HE_Ki7 model) and nomogram, leveraging features from multi-modal data (HE and Ki67) along with clinical variables, outperform the single-modal HE model or Ki67 model in identifying Stage I-II and Stage III colorectal cancer.In clinical DCA, both the combined model and nomogram demonstrate higher net benefits.

F I G U R E 6
The construction of the nomogram was accomplished using the predictive outcomes of the pathomics HE model (HE_score) and pathomics Ki67 model (Ki67_score), in conjunction with clinical variables (CEA, CA724, CA125, and CA242) (A).ROC analysis of the pathomics HE model (HE), pathomics Ki67 model (Ki67), combined model (HE_Ki67) and nomogram was conducted in both the training (B) and test cohorts (C).Decision curve analysis (DCA) was performed on three models and nomogram for classifying between Stages I-II and Stage III colorectal cancer in the training (D) and test (E) cohorts, respectively.
54 patients in the testing cohort.Summary statistics of clinical and pathological features of the patients are presented in Table1.Statistical analysis was performed for Stages I-II and Stage III in both the training and testing cohorts.Age, gender, tumor size, differentiation, vascular thrombosis, neural invasion, CK20 (IHC), HER2 (IHC), and most hematologic tumor markers showed no significant statistical differences.CA242 and CA199 displayed a statistical significance with a p-value less than 0.05 in the training cohort.Univariate regression analysis of the 15 variables in the clinical and pathological data revealed p-values less than 0.05 for CA242, CA724, CEA, and CA125.A subsequent multivariate regression analysis of the variables with pvalues less than 0.05 showed that CA242 and CA125 remained significant.The odds ratios (OR) and p-values for univariate and multivariate analysis of clinical and pathological variables are shown in Table2.
Note: CK20 (IHC), the presence of cytokeratin 20 in tissue samples by using of immunohistochemistry. HER2 (IHC), the presence of Human Epidermal Growth Factor Receptor 2 in tissue samples by using of immunohistochemistry. HER2 (IHC) results are categorized as follows: 0, no HER2 expression; 1+, weakly positive HER2 expression; 2+, moderately positive HER2 expression; 3+, strongly positive HER2 expression.Abbreviation: AFP, alpha-fetoprotein; CA125, carbohydrate antigen125; CA153, carbohydrate antigen153; CA199, carbohydrate antigen 199; CA242, carbohydrate antigen 242; CA724, carbohydrate antigen 724; CEA, carcinoembryonic antigen; IHC, immunohistochemistry; SD, standard deviation.usedforSpearmanrankcorrelationtests,z-scorenormalization, LASSO regression analysis, univariate regression analysis, and multivariate regression analysis, as well as for generating ROC curves and clinical decision curves.Variables with a univariate regression analysis p-value <0.05 were included in the multivariate regression analysis, and these variables were also incorporated into the combined model and nomogram construction.The hardware environment for this study includes an Intel Core i7-13700KF 3.40GHz CPU, an NVIDIA GeForce RTX 4070Ti GPU with CUDA 12.2.79,and64GBDDR4memory.The software environment comprises Python 3.7.12as the programming language, scikit-learn 1.0.2 as the machine learning library, and Jupyter Notebook 6.5.4 as the development environment.3|RESULTS3.1 | Clinical and pathological features of patientsThis study involved 267 patients diagnosed with colorectal cancer, comprising 213 patients in the training cohort Note: For detailed explanations of the abbreviations for the variables, please refer to Table1.Abbreviation: AFP, alpha-fetoprotein; CA125, carbohydrate antigen125; CA153, carbohydrate antigen153; CA199, carbohydrate antigen 199; CA242, carbohydrate antigen 242; CA724, carbohydrate antigen 724; CEA, carcinoembryonic antigen; IHC, immunohistochemistry; SD, standard deviation.FI G U R E 2 The loss value of deep learning HE_ResNet-18 model (A) and Ki67_ResNet-18 model (B) in the training patches with the iteration steps.and

Table 4 .
Performance of models for predicting discrimination between Stages I-II and Stage III colorectal cancer in training and test cohorts.
T A B L E 4